Speech Driven MPEG-4 Facial Animation for Turkish
نویسندگان
چکیده
In this study, a system, that generates visual speech by synthesizing 3D face points, has been implemented. The synthesized face points drive MPEG-4 facial animation. To produce realistic and natural speech animation, a codebook based technique, which is trained with audio-visual data from a speaker, was employed. An audio-visual speech database was created using a 3D facial motion capture system that was developed for this study. To improve the performance of the system when used by different speakers, a further training was performed with audio-only data from a small number of speakers. The resulting system is capable of animating faces from an input speech of any Turkish speaker.
منابع مشابه
Real-Time Speech-Driven Face Animation
This chapter presents our research on real-time speech-driven face animation. First, a visual representation, called Motion Unit (MU), for facial deformation is learned from a set of labeled face deformation data. A facial deformation can be approximated by a linear combination of MUs weighted by the corresponding MU parameters (MUPs), which are used as the visual features of facial deformation...
متن کاملA Low Bit-rate Web-enabled Synthetic Head with Speech-driven Facial Animation
In this paper, an approach that animates facial expressions through speech analysis is presented. An individualized 3D head model is first generated by modifying a generic head model, where a set of MPEG-4 Facial Definition Parameters (FDPs) has been pre-defined. To animate realistic facial expressions of the 3D head model, key frames of facial expressions are calculated from motion-captured da...
متن کاملAn MPEG-4 Facial Animation System Driven by Synthetic Speech
This paper’ provides an overview o f the act iv i t ies that have led to the development o f a prototype appl icat ion o f a “talking head” compliant with MPEG-4 spectfication. The work done so far Jits in the context of one of the recent work-i tems def ined by the ISOBEC JTCI/SC29/WGll world-wide known as MPEG. This IS0 Working Group is now in the process o f de f in ing a uni fy ing framewor...
متن کاملText2Video: Text-Driven Facial Animation using MPEG-4
We present a complete system for the automatic creation of talking head video sequences from text messages. Our system converts the text into MPEG-4 Facial Animation Parameters and synthetic voice. A user selected 3D character will perform lip movements synchronized to the speech data. The 3D models created from a single image vary from realistic people to cartoon characters. A voice selection ...
متن کاملCoarticulation and speech synchronization in MPEG-4 based facial animation
In this paper, we present a novel coarticulation and speech synchronization framework compliant with MPEG-4 facial animation. The system we have developed uses MPEG-4 facial animation standard and other development to enable the creation, editing and playback of high resolution 3D models; MPEG-4 animation streams; and is compatible with well-known related systems such as Greta and Xface. It sup...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004